Adaptive Controllers for Assistive Robotic Devices

Lower extremity assistive robotic devices, such as exoskeletons and prostheses, have the potential to improve mobility for millions of individuals, both healthy and disabled. These devices are designed to work in conjunction with the user to enhance or replace lost functionality of a limb. Given the large variability in walking dynamics from person to person, it is still an open research question of how to optimally control such devices to maximize their benefit for each individual user. In this context, it is becoming more and more evident that there exists no "one size fits all" solution, but that each device needs to be tuned on a subject-specific basis to best account for each user's unique gait characteristics. However, the controllers that run in the background of these devices to dictate when and what type of actuation to deliver often have up to a hundred different parameters that can be tuned on a subject-specific basis. To hand tune each parameter can be an extremely tedious and time consuming process. Additionally, current tuning practices often rely on subjective measures to inform the fitting process. To address the current obstacles associated with device control and tuning, I have developed novel tools that overcome some of these issues through the design of control architectures that autonomously adapt to the user based upon real-time physiological measures. This approach frames the tuning process of a device as a real-time optimization and allows for the device to co-adapt with the wearer during use. As an outcome of these approaches, I have been able to investigate what qualities of a device controller are beneficial to users through the analysis of whole body kinematics, dynamics, and energetics. The framework of my research has been broken down into four major projects. First, I investigated how current standards of processing and analyzing physiological measures could be improved upon. Specifically, I focused on how to analyze non-steady-state measures of metabolic work rate in real time and how the noise content of theses measures can inform confidence analyses. Second, I applied the techniques I developed for analyzing non-steady-state measures of metabolic work rate to conduct a real-time optimization of powered bilateral ankle exoskeletons. For this study I employed a gradient descent optimization to tune and optimize an actuation timing parameter of these simple exoskeletons on a subject-specific basis. Third, I investigated how users may use an adaptive controller where they had a more direct impact on the adaptation via their own muscle recruitment. In this study, I designed and tested an adaptive gain proportional myoelectric controller with healthy subjects walking in bilateral ankle exoskeletons. Through this work I showed that subjects adapted to using increased levels of total ankle power compared to unpowered walking in the devices. As a result, subjects decreased power at their hip and were able to achieve large decreases in their metabolic work rate compared to unpowered walking. Fourth, I compared how subjects may use a controller driven by neural signals differently than one driven by mechanically intrinsic signals. The results of this project suggest that control based on neural signals may be better suited for therapeutic rehabilitation than control based on mechanically intrinsic signals. Together, these four projects have drastically improved upon subject-specific control of assistive devices in both a research and clinical setting.PHDMechanical EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttps://deepblue.lib.umich.edu/bitstream/2027.42/144029/1/jrkoller_1.pd

Yang-Mills Theory in Six-Dimensional Superspace

The superspace approach provides a manifestly supersymmetric formulation of supersymmetric theories. For N= 1 supersymmetry one can use either constrained or unconstrained superfields for such a formulation. Only the unconstrained formulation is suitable for quantum calculations. Until now, all interacting N&gt;1 theories have been written using constrained superfields. No solutions of the nonlinear constraint equations were known. In this work, we first review the superspace approach and its relation to conventional component methods. The difference between constrained and unconstrained formulations is explained, and the origin of the nonlinear constraints in supersymmetric gauge theories is discussed. It is then shown that these nonlinear constraint equations can be solved by transforming them into linear equations. The method is shown to work for N=1 Yang-Mills theory in four dimensions. N=2 Yang-Mills theory is formulated in constrained form in six-dimensional superspace, which can be dimensionally reduced to four-dimensional N=2 extended superspace. We construct a superfield calculus for six-dimensional superspace, and show that known matter multiplets can be described very simply. Our method for solving constraints is then applied to the constrained N=2 Yang-Mills theory, and we obtain an explicit solution in terms of an unconstrained superfield. The solution of the constraints can easily be expanded in powers of the unconstrained superfield, and a similar expansion of the action is also given. A background-field expansion is provided for any gauge theory in which the constraints can be solved by our methods. Some implications of this for superspace gauge theories are briefly discussed. </p

Biomechanics and energetics of walking in powered ankle exoskeletons using myoelectric control versus mechanically intrinsic control

Abstract Background Controllers for assistive robotic devices can be divided into two main categories: controllers using neural signals and controllers using mechanically intrinsic signals. Both approaches are prevalent in research devices, but a direct comparison between the two could provide insight into their relative advantages and disadvantages. We studied subjects walking with robotic ankle exoskeletons using two different control modes: dynamic gain proportional myoelectric control based on soleus muscle activity (neural signal), and timing-based mechanically intrinsic control based on gait events (mechanically intrinsic signal). We hypothesized that subjects would have different measures of metabolic work rate between the two controllers as we predicted subjects would use each controller in a unique manner due to one being dependent on muscle recruitment and the other not. Methods The two controllers had the same average actuation signal as we used the control signals from walking with the myoelectric controller to shape the mechanically intrinsic control signal. The difference being the myoelectric controller allowed step-to-step variation in the actuation signals controlled by the user’s soleus muscle recruitment while the timing-based controller had the same actuation signal with each step regardless of muscle recruitment. Results We observed no statistically significant difference in metabolic work rate between the two controllers. Subjects walked with 11% less soleus activity during mid and late stance and significantly less peak soleus recruitment when using the timing-based controller than when using the myoelectric controller. While walking with the myoelectric controller, subjects walked with significantly higher average positive and negative total ankle power compared to walking with the timing-based controller. Conclusions We interpret the reduced ankle power and muscle activity with the timing-based controller relative to the myoelectric controller to result from greater slacking effects. Subjects were able to be less engaged on a muscle level when using a controller driven by mechanically intrinsic signals than when using a controller driven by neural signals, but this had no affect on their metabolic work rate. These results suggest that the type of controller (neural vs. mechanical) is likely to affect how individuals use robotic exoskeletons for therapeutic rehabilitation or human performance augmentation.https://deepblue.lib.umich.edu/bitstream/2027.42/143850/1/12984_2018_Article_379.pd

Learning to walk with an adaptive gain proportional myoelectric controller for a robotic ankle exoskeleton

Abstract Background Robotic ankle exoskeletons can provide assistance to users and reduce metabolic power during walking. Our research group has investigated the use of proportional myoelectric control for controlling robotic ankle exoskeletons. Previously, these controllers have relied on a constant gain to map user’s muscle activity to actuation control signals. A constant gain may act as a constraint on the user, so we designed a controller that dynamically adapts the gain to the user’s myoelectric amplitude. We hypothesized that an adaptive gain proportional myoelectric controller would reduce metabolic energy expenditure compared to walking with the ankle exoskeleton unpowered because users could choose their preferred control gain. Methods We tested eight healthy subjects walking with the adaptive gain proportional myoelectric controller with bilateral ankle exoskeletons. The adaptive gain was updated each stride such that on average the user’s peak muscle activity was mapped to maximal power output of the exoskeleton. All subjects participated in three identical training sessions where they walked on a treadmill for 50 minutes (30 minutes of which the exoskeleton was powered) at 1.2 ms-1. We calculated and analyzed metabolic energy consumption, muscle recruitment, inverse kinematics, inverse dynamics, and exoskeleton mechanics. Results Using our controller, subjects achieved a metabolic reduction similar to that seen in previous work in about a third of the training time. The resulting controller gain was lower than that seen in previous work (β=1.50±0.14 versus a constant β=2). The adapted gain allowed users more total ankle joint power than that of unassisted walking, increasing ankle power in exchange for a decrease in hip power. Conclusions Our findings indicate that humans prefer to walk with greater ankle mechanical power output than their unassisted gait when provided with an ankle exoskeleton using an adaptive controller. This suggests that robotic assistance from an exoskeleton can allow humans to adopt gait patterns different from their normal choices for locomotion. In our specific experiment, subjects increased ankle power and decreased hip power to walk with a reduction in metabolic cost. Future exoskeleton devices that rely on proportional myolectric control are likely to demonstrate improved performance by including an adaptive gain.http://deepblue.lib.umich.edu/bitstream/2027.42/115879/1/12984_2015_Article_86.pd

Motor modules during adaptation to walking in a powered ankle exoskeleton

Abstract Background Modules of muscle recruitment can be extracted from electromyography (EMG) during motions, such as walking, running, and swimming, to identify key features of muscle coordination. These features may provide insight into gait adaptation as a result of powered assistance. The aim of this study was to investigate the changes (module size, module timing and weighting patterns) of surface EMG data during assisted and unassisted walking in an powered, myoelectric, ankle-foot orthosis (ankle exoskeleton). Methods Eight healthy subjects wore bilateral ankle exoskeletons and walked at 1.2 m/s on a treadmill. In three training sessions, subjects walked for 40 min in two conditions: unpowered (10 min) and powered (30 min). During each session, we extracted modules of muscle recruitment via nonnegative matrix factorization (NNMF) from the surface EMG signals of ten muscles in the lower limb. We evaluated reconstruction quality for each muscle individually using R2 and normalized root mean squared error (NRMSE). We hypothesized that the number of modules needed to reconstruct muscle data would be the same between conditions and that there would be greater similarity in module timings than weightings. Results Across subjects, we found that six modules were sufficient to reconstruct the muscle data for both conditions, suggesting that the number of modules was preserved. The similarity of module timings and weightings between conditions was greater then random chance, indicating that muscle coordination was also preserved. Motor adaptation during walking in the exoskeleton was dominated by changes in the module timings rather than module weightings. The segment number and the session number were significant fixed effects in a linear mixed-effect model for the increase in R2 with time. Conclusions Our results show that subjects walking in a exoskeleton preserved the number of modules and the coordination of muscles within the modules across conditions. Training (motor adaptation within the session and motor skill consolidation across sessions) led to improved consistency of the muscle patterns. Subjects adapted primarily by changing the timing of their muscle patterns rather than the weightings of muscles in the modules. The results of this study give new insight into strategies for muscle recruitment during adaptation to a powered ankle exoskeleton.https://deepblue.lib.umich.edu/bitstream/2027.42/140718/1/12984_2017_Article_343.pd

Collagen-induced Arthritis Is Reduced in 5-Lipoxygenase-activating Protein-deficient Mice

Collagen-induced arthritis in the DBA/1 mouse is an experimental model of human rheumatoid arthritis. To examine the role of leukotrienes in the pathogenesis of this disease, we have developed embryonic stem (ES) cells from this mouse strain. Here, we report that DBA/1 mice made deficient in 5-lipoxygenase-activating protein (FLAP) by gene targeting in ES cells develop and grow normally. Zymosan-stimulated leukotriene production in the peritoneal cavity of these mice is undetectable, whereas they produce substantial amounts of prostaglandins. The inflammatory response to zymosan is reduced in FLAP-deficient mice. The severity of collagen-induced arthritis in the FLAP-deficient mice was substantially reduced when compared with wild-type or heterozygous animals. This was not due to an immunosuppressive effect, because anti-collagen antibody levels were similar in wild-type and FLAP-deficient mice. These data demonstrate that leukotrienes play an essential role in both the acute and chronic inflammatory response in mice

Inequality in learning outcomes: Unveiling educational deprivation through complex network analysis

Understanding which factors are determinant to guarantee the human right to education entails the study of a large number of non-linear relationships among multiple agents and their impact on the properties of the entire system. Complex network analysis of large-scale assessment results provides a set of unique advantages over classical tools for facing the challenge of measuring inequality gaps in learning outcomes and recognizing those factors associated with educational deprivation, combining the richness of qualitative analysis with quantitative inferences. This study establishes two milestones in educational research using a census high-quality data from a Latin American country. The first one is to provide a direct method to recognize the structure of inequality and the relationship between social determinants as ethnicity, socioeconomic status of students, rurality of the area and type of school funding and educational deprivation. The second one focus in unveil and hierarchize educational and non-educational factors associated with the conditional distribution of learning outcomes. This contribution provides new tools to current theoretical framework for discovering non-trivial relationships in educational phenomena, helping policymakers to address the challenge of ensuring inclusive and equitable education for those historically marginalized population groups.info:eu-repo/semantics/acceptedVersio

Shrubland primary production and soil respiration diverge along European climate gradient

Above- and belowground carbon (C) stores of terrestrial ecosystems are vulnerable to environmental change. Ecosystem C balances in response to environmental changes have been quantified at individual sites, but the magnitudes and directions of these responses along environmental gradients remain uncertain. Here we show the responses of ecosystem C to 8–12 years of experimental drought and night-time warming across an aridity gradient spanning seven European shrublands using indices of C assimilation (aboveground net primary production: aNPP) and soil C efflux (soil respiration: Rs). The changes of aNPP and Rs in response to drought indicated that wet systems had an overall risk of increased loss of C but drier systems did not. Warming had no consistent effect on aNPP across the climate gradient, but suppressed Rs more at the drier sites. Our findings suggest that above- and belowground C fluxes can decouple, and provide no evidence of acclimation to environmental change at a decadal timescale. aNPP and Rs especially differed in their sensitivity to drought and warming, with belowground processes being more sensitive to environmental change

Integrated information increases with fitness in the evolution of animats

One of the hallmarks of biological organisms is their ability to integrate disparate information sources to optimize their behavior in complex environments. How this capability can be quantified and related to the functional complexity of an organism remains a challenging problem, in particular since organismal functional complexity is not well-defined. We present here several candidate measures that quantify information and integration, and study their dependence on fitness as an artificial agent ("animat") evolves over thousands of generations to solve a navigation task in a simple, simulated environment. We compare the ability of these measures to predict high fitness with more conventional information-theoretic processing measures. As the animat adapts by increasing its "fit" to the world, information integration and processing increase commensurately along the evolutionary line of descent. We suggest that the correlation of fitness with information integration and with processing measures implies that high fitness requires both information processing as well as integration, but that information integration may be a better measure when the task requires memory. A correlation of measures of information integration (but also information processing) and fitness strongly suggests that these measures reflect the functional complexity of the animat, and that such measures can be used to quantify functional complexity even in the absence of fitness data.Comment: 27 pages, 8 figures, one supplementary figure. Three supplementary video files available on request. Version commensurate with published text in PLoS Comput. Bio

Critical role of Bcl11b in suppressor function of T regulatory cells and prevention of inflammatory bowel disease

Bcl11b is required for optimal FoxP3 expression and suppressor function by regulatory T cells and for the generation of inducible regulatory T cells